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V  Rapid  Integration  and  Test  Environment 

Systems  Center  I 

PACIFIC 


A  fundamental  change  in  the  way  C4ISR  software  is  acquired.... 

T  Commercial  best-practice  software  engineering  standards  &  processes 
T  Explicit  governance  and  contractual  guidance 

▼  Automated  testing  and  report  generation  tools 

▼  Enables  Agile  Development  and  Rapid  Fielding 


Provided  via  a  Government-run  development  and  test  facility 


RITE  Benefits 

INCREASES 

DECREASES 

Software  Quality 

Development  Cost 

System  Reliability 

Sustainment  Cost 

System  Security 

Time  to  Field 

Engineering  Productivity 

Program  Risk 
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RITE’S  History 


▼  RITE  was  initiated  over  7  years  ago  as  a 
response  to  program  of  record  challenges  in 
managing,  producing  and  fielding  C2  software 

▼  Evolution  of  commercial  best  practices  in  agile 
development  tailored  to  work  within  the  DoD 
acquisition  structure 

▼  Key  Enabler  of  Rapid  IT  acquisition  programs 

▼  RITE  being  leveraged  by  16  software  programs 
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Contracts 


•  Boilerplate 
contract 
language  - 
Gov  purpose 
Rights 

•  Adding 
expectation  of 
quality  to 
contracting 
language 
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Integrates 
continuous 
testing  into 
Development 
stage 


Institutionalize 
source  code 
analysis 


•  Template 
SOW’s 
created 


Automates  and 
focuses  testing 

Standardizes 
tools  and  test 
cases 
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Enhances 
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project  comms 
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to  respond  more 
quickly  and  with 

Sharable 

Software 

Testing  tools 
and  data 

authority 

Source  Code  Management 
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Leveraging  Automation 

•  Static  Code  Analysis 

•  Quality  Code  Review 

•  Code  Complexity 

•  Compliance  checks 

•  Automated  Regression  Tests 

•  Error  Tracking 

•  Centralized  Monitoring 


Subject  Matter  Expertise 

•  Program  Assessment  Reports 

•  Software  Quality  Assessment 

•  System  Quality  Assessment 

•  Engineering  Recommendations 
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Application  of  RITE 
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Rapid  IT  Process  &  RITE  Process 
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Build  A 
Decision 

Contractor 


Government 

COTF 


Test  Artifacts 
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Continuous  Data  Collection  &  Validation  for  Test  Report 


Test  Artifacts 


Continuous  Data  Collection  &  Validation  for  Test  Report 
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Field 
Decision 


COTF  Q  Test  Report 
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Single  Sprint  Activities 


Management 


Schedule 


T 


Tracking 
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Developers 


Developer  IDE's 


T 


Source  Code 


Reports 

(feed  next  sprint) 


-  Acceptance  Test 

-  Code  Conformance 
Information  Assurance 

-  Code  Coverage 

-  Error  Detection 
-  Code  Duplication 


Assessors  (DT/OT/IA) 


Code  Review 


Build  Servers 


Automated  Functional  Testing 


Bug  Tracking 
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RITE  program 
metrics 


T  RITE  enables  visibility  of  program  using  metrics 

■  Early  address  of  critical  issues 

■  Movement  of  critical  resources  to  fix  problem  areas 

■  Determine  quality  and  predict  sustainment 

■  Ready  access  to  health  of  program 

■  Mitigate  high  risk  items  sooner 


FOR  OFFICIAL  USE  ONLY 


SW  Quality  Metrics:  SP9 

SLOC ,  Defects,  Defect  Density 

SPACE  AND  MISSILE  SYSTEMS  CENTER 


Duplicate  Code  Analysis  Report 
f  aids  in  STR  propagation  detection 
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s7£.m,  RITE  Tool  Suite  (Evolutionary) 


Tool 

Type  Tool 

Measure 

Category 

Wiki 

Agile  Development  Collaboration 

Allows  for  sharing  of  artifacts,  communication  of 
development  team 

Management  & 
Developer 

JIRA 

Agile  Issue  Tracker 

Workflow  and  Issue  tracker  to  conduct  sprints.  Plugins 
used  to  define  workflow  and  Agile  Method 

Subversion 

Source  Code  Repository 

Software  Repository  for  Source  Code  Management 

Lattix 

Dependency  Analysis 

Modularity  and  Complexity 

FindBugs 

Static  Analysis 

Defects  in  Java  code 

PMD 

Static  Analysis 

Programming  flaws  in  Java,  JavaScript,  XML,  and  XSL. 

Cut  and  Paste  Detector  for  C,  C#,  PHP,  Python 

Static  Source 

Code  Quality 

Klocwork 

Static  Analysis 

C,  C#,  .NET  Code  refactoring  and  reliability 

Coverity 

Static  Analysis 

Defects  in  C,  C#,  .NET  and  Security 

Atomiq 

Static  Analysis 

Duplicate  Code  for  Security/IA 

Rational  Purify  Suite 

Dynamic  Analysis 

RunTime  Debugger 

MCCABE  IQ 

Static  Analysis 

Cyclomatic  Complexity  and  KSLOC.  All  Languages 

HP  Fortify 

Security  Scan 

STIG  and  Vulnerabilities 

Security  &  IA 

GSSAT  (GOTS) 

Security  Scan 

STIG  and  Vulnerabilities 

AutolT 

Automated  Test 

Scripting  Engine  for  Automation 

Functional 

Testing 

TestComplete 

Automated  Test 

Automation  Orchestration  Suite 

ATRT 

Automated  Test 

Interface  Testing  and  Data  Producer 
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RITE  enables  Critical 
Bug  Finds 


▼  Early  software  assessments  and  automated  testing 
provided  for  Identification  of  over  100  “Critical”  Software 
bugs  up  to  8  months  earlier  than  expected 

>  Detection  during  development  integration  cycle  vs  Major 
Development  Test 


O&S  Cost  Analysis 
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Jim  Wilson 

Cost  Analysis  Research  Division 
Institute  for  Defense  Analyses 
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RITE  allows  us  to 
identify  defects  earlier  in 
the  Development  phase 
and  reduce  rework  costs 


Requirements 


We  spend  too 
much  money  in 
this  column. 
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Storefront/Tactical  Marketplace 


▼  Storefront  Benefits: 

•  Speed  to  Capability:  Enables  rapid  fielding  of  capabilities  to  the 
warfighter  by  automating  the  distribution,  updating,  and  installation 
of  components 

•  Simplified  User  Experience:  Provides  a  common  presentation, 
distribution,  update,  and  installation  service  for  all  PoRs 

•  Driving  Down  Cost:  Reduces  fielding  and  deployment  costs 
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Storefront/Tactical 
Marketplace  Initiatives 
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▼  SSC-PAC  is  establishing  a  Navy  App  Store  ecosystem  (systems, 
processes,  guidance,  etc.)  to  enable  accelerated  fielding  of  new 
capabilities  to  the  warfighter  at  the  tactical  edge 

▼  SSC-PAC  has  an  open  dialogue  across  the  DoD  Storefront 
stakeholders: 

•  DoD  policy  working  group  aligning  the  Widget  technologies  across 
the  enterprise  (DoD  Widget  Working  Group) 

•  Member  of  the  Ozone  Widget  Government  Open  Source  Software 
(OWF  GOSS) 

•  Technical  Exchange  Meetings  with  other  Storefront  efforts: 

•  JC2CUI  -  DISA  PEO  C2C  /  GCCS-J  Application  Store,  DI2E 
Storefront,  PEO  C4I  Storefront 
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Notional  OV-1  Tactical  Storefront 
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Agile  Development 


Test  &  Approval 

Ashore  &  Tactical 
Storefront 


PoR  Developers 
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Rapid  IT  &  RITE  Process 
Using  Storefront/Tactical  Marketplace 


Build  A 
Decision 

Contractor 


Delivery 
to  Gov’t 


Government 

COTF 
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IT&E 


Test  Artifacts 
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Continuous  Data  Collection  &  Validation  for  Test  Report 


Single  Sprint  Activities 


Developers 


Reports 
(feed  next 
sprint) 


Acceptance  Test 

■  Code 

Conformance 
-  Information 
Assurance 
■  Code  Coverage 
•  Error  Detection 

■  Code 


Assessors  (DT/OT/IA) 


Automated 

Functional 
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▼  Program  visibility  into  production 

T  Rapid  IT  and  RITE  process  alignment 
T  Metrics  to  drive  quality 
T  Better  productivity 

▼  Tools  to  assess  risk  and  quality 
T  Cost  savings 


RITE  Benefits 

INCREASES 

DECREASES 

Software  Quality 

Development  Cost 

System  Reliability 

Sustainment  Cost 

System  Security 

Time  to  Field 

Engineering  Productivity 

Program  Risk 
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Questions? 
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Mr.  Michael  Morris 

Space  and  Naval  Warfare  Systems  Center  Pacific 
53560  Hull  Street 


San  Diego,  California  92152-5001 
(619)  553-1260 
Michael.a.morris4@navy.mil 

Ms.  Amanda  George 

Captain  George  Galdorisi 

Ms.  Angela  Bowers 

Space  and  Naval  Warfare  Systems 

(U.S.  Navy  -  Retired) 

Space  and  Naval  Warfare  Systems 

Center  Pacific 

Space  and  Naval  Warfare  Systems 

Center  Pacific 

53560  Hull  Street 

Center  Pacific 

53560  Hull  Street 

San  Diego,  California  92152-5001 

53560  Hull  Street 

San  Diego,  California  92152-5001 

(619)  553-2066 

San  Diego,  California  92152-5001 

(619)  553-9388 

Amanda.george@navy.mil 

(619)  553-2104 
George.galdorisi@navy.mil 

Angela.n.bowers@navy.mil 

A 


17 


